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Abstract 

Classical mesh partitioning algorithms were designed 
for rather static situations, and their straightforward ap- 
plication in a dynamical framework may lead to unsatis- 
factory results, e.g: excessive data migration among pro- 
cessors. Funhermore, special attention should be paid to 
their amenability to parallelization. In this paper, a novel 
parallel method for the dynamic partitioning oj adaptive 
unstructured meshes is described. It is based on a linear 
representation of the mesh using self-avoiding walks. 


1. Introduction 

The three biggest issues in the parallel implementation 
of adaptive unstructured grid applications are runtime parti- 
tioning. mapping, and data locality. However, it is generally 
believed that graph partitioning is no longer the bottleneck 
but data remapping is (see [1]). This is because very pow- 
erful general-purpose graph partitioning methods have been 
developed over the last decade (see [2]). Why then do we 
propose yet another new partitioner? This is becau.se an in- 
timate relationship exists between the three big issues, and 
resolvins one in an optimal tasliion does not automatically 
imply the same for the otlicrs. Determining a new “opti- 
mal” panitioning at nmtime can be done veiy rapidly, but 
wliat is tlie cost for moving around a lot of data accord- 
ingly? EtTective teclmiques for a better exploitation of data 
lociility Ixtscd ot\ space-filling curves [7] have bceti success- 
fully applied in the nmtime partitioning for N-body simu- 
lations and finite element methods (FEM). The expectation 
that the serialization inherent in such curves would elim- 
inate the panitioning and mapping problem did not com- 
pletely live up to, primarily becau.se ot the dilficulties in 
their constniction for non-siraply connected domains. On 
the other luuid. panittoners do not necesstinly preserve in 


their repartitioning structures what have to be established 
for the exploitation of locality. Thus, there is a clear need 
for a unifying framework. 

A key consideration for efficient runtime partitioning is 
the reuse of existing partition information. We suggest a 
novel concept which should allow a much faster deforma- 
tion of partition boundaries than diffusive methods, and 
which does not require any post-partitioning smootliing op- 
eration. Furthermore, it takes into account the linearization 
of partitions by self-avoiding walks (see [4]). Our approach 
views the mesh as a graph, but also as determined by the 
structure of the underlying physical domain, thereby link- 
ing the three main issues to mesh generation. 

In the following sectioas. we first sketch the theoretical 
background and then discuss some algorithmic aspects of 
the constructions involved. In view of its capabilities for 
automatic task migration and the very fine-grained synchro- 
nization structure of the algorithms, a parallel implementa- 
tion using a system supporting multithreading [5] seems to 
be the most promising approach. 

In Section 2, we sketch a linearization technique based 
on self-avoiding walks. In Section 3, we develop a new par- 
titioning method that is suitable for runtime purposes and 
which respects our linear representation ot meshes. 

2. Self-Avoiding Walks 

Consider an arbitrary two-dimensional mesh A selj- 
avoiding walk (SAW) over M is an enumeration of the tn- 
angles of M such that two triimgles following one another 
in a walk, share lui edge or a vertex. Note that an SAW vis- 
its each triangle exactly once. Since we allow consecutive 
triangles to sluire either an edge or a vertex, this is not a 
Hiimilioniiui cycle problem on the diuil graph. In tact, the 
tion-Hiimiltonicity of the diitils ot simple meshes forces us 
to relax certain assumptions. An SAW “eniers" a given tri- 
angle over an edge or a vertex. ;md "leaves" it over anolher 



Rgure 1. An example of an SAW. 



Figure 2. Space-filling curves for uniformly- 
refined and adaptively-refined triangulations. 


edge or vertex. In the cases where the SAW jumps over ver- 
tices, we imply that the triangles following one another do 
not share an edge. 

Intuitively, walks going only over edges show better lo- 
cality. Since we want to stay away from the problem of 
Hamiltonicity, we make a weaker assumption about the be- 
havior of the SAWs which however excludes cases of ex- 
treme non-locality. In the following, we consider a special 
class of SAWs which we call proper self-avoiding walks 
(PSAW). A PSAW is an SAW where for any three triangles 
following one another in the walk, we do not allow jumping 
twice over the same vertex. (Tl^ SAW shown in Fig. 1 is 
proper.) The precise statement of the problem, the overall 
machinery, and proofs for the proposition formulated be- 
low can be found in [4]. The reference also contains some 
performance results for a simple implementation of the un- 
derlying algorithm. 

Proposition 2.1. There exists a proper self^avoiding walk 
for an arbitrary triangular mesh M with prescribed initial 
and final triangles. □ 

The proof of Proposition 2.1 consists of two parts. In 
the first part, we prove the existence of PSAWs (without 
boundary conditions). This is done by induction over the 
number of triangles in the mesh, and extends an existing 
PSAW over to a larger mesh. This step of the proof also pro- 
vides a set of elementary ailes which can be used to formu- 
late an 0(n logn) algorithm for constructing PSAWs with 
a given initial triangle over arbitrary unstructured meshe?. 
The value of such rules becomes apparent if practical ques- 
tions such as tlte proper extension of existing “incomplete” 
walks are addressed (and most of the difficulty of the proof 
is in this part). In the second part of tlie proof, we show that 
titere is an incomplete PSAW from the initial to the final 
triangle, and then use the techniques from the first part to 
complete it [4J. 

For the hierarcliical refinement of unsimctured grids, 
the consiniction of PSAWs can be considerably simplified. 
In |4|, we gave a con.stmction of PSAWs for such cases. It 
turns i)ut iliat (his process is equivalent to an intennediate 


stage of a modified Sierpifiski curve [7] (see Fig. 2), if we 
interpret the (geometric) curve visiting a triangle twice as a 
jump over a vertex. Therefore, the PSAW “inherits” almost 
ail of the nice locality properties of such a curve. As a con- 
sequence, in the case of hierarchical adaptation, we have to 
modify an existing walk only in the regions affected by the 
adaptation. 

3. Linearization^ Adaptation, and Partitioning 

Consider the following application scenario: start with a 
pie-generated mesh which will be subject to dynamic and 
hierarchical coarsening and refinement, i.e., all triangles 
generated at runtime are contained within the triangles of 
the initial mesh. Within the partitions to be constructed, we 
would like to achieve good data locality, represented by a 
PSAW. On the other hand, a runtime deformation of par- 
tition boundaries should not require a complete rebuilding 
of the linearization. Although PSAWs exist for arbitrary 
meshes (Proposition 2. 1 ), some “guidance” or at least a few 
“warning signs” on the mesh would be helpful. Greedy par- 
titioners tend to ignore these “warning signs”, occasionally 
resulting in disconnected partitions and a sensitive depen- 
dence on the starting point. The level approach behind 
greedy partitioning, taken from the Cuthill-McKee algo- 
rithm [2, 3], tends to fail in regions where the mesh or the 
physical domain undergoes structural changes (e.g., sudden 
shrinking or expansion, or the presence of comers). 

In the next section, we briefly describe our novel bound- 
ary contour coloring strategy which provides some impor- 
tant information about the mesh. We assume that the luider- 
lying physical domain has a non-empty boundary, 

3.1. Boundary Contour Coloring 

Wc Ciill a mapping M N, which a.ssigns to cacli tri- 
angle of M a natural number, a coloring. Given a mesh M. 
we consider tlie coloring that Ccin be obtained by iteratively 
applying the following mles; 



• All triangles which share an edge or a vertex with the 
boundary of M have color 0. 

• All uncolored triangles which share an edge or a vertex 
with a triangle of color i have color i + 1. 

We call this coloring a boundary contour coloring. Inter- 
preting color as height, the boundary contour coloring of a 
mesh gives a mountainous terrain over the mesh with (local) 
maxima and saddle points. Figure 3 shows an example of 
a mesh containing 1286 triangles (thanks to J. Shewchuck 
for his Triangle tool), that produces a sufficiendy interesdng 
boundary contour coloring. 



Figure 3. The letter A mesh. 

Unfortunately, a black-and-white document does not ef- 
fectively reproduce the coloring. We thus describe the col- 
oring in words. The boundary contour coloring makes the 
mesh appear as separated into leafs or layers wliich can be 
“peeled off”. The coloring of the mesh in Fig. 3 contains 
five different layers. The left leg of the A mesh is thituier 
and has colors 0 and I, except for a cluster of ten triangles 
of color 2 in the lower left. The color 1 layer branches near 
the middle bar into two pans, one going further up and the 
other going to the right. The thicker right leg lias four layerji 
of colors 0, 1,2, and 3, as well as a cluster of three tritingles 
of color 4 in the lower right. All die layers up to and in- 
cluding color 2 are connected whereas die layer ot color 3, 
as the ridge of a mountain, is discomiected (three compo- 
nents). The contour of color 1 branching from the left joins 
up with the corresponding contoiu from the right, where it 
shows tlie same branching behavior as the one on tlie lett. 

Denote by the set of triangles of color c. In general, 
the color contour of Tc does not have a proper interior in the 
following sense: for a triangle t € Tc, 0 < c < c„,ax, ut 
lca.st one of the tlirce neighbors sharing lui edge with t usu- 
ally has a different color while tlie other two arc ot the same 


color. If all three neighbors have the same color as t, it in- 
dicates a local maximum, a saddle point, or an “untying" or 
“branching" of contours. Only the last possibility is critical, 
as we shall see below. The color foliation has a nontrivial 
structure, but apart from the branches, looks like a rectan- 
gular region with colored fibers. If we wish to exploit this 
structure, we will have to determine the boundaries of such 
regions. 

The boundary contour coloring induces an edge coloring 
as follows: 

• An edge on the domain boundary or on the boundary be- 
tween two color layers is assigned the color - 1. 

• An edge whose two adjacent triangles are of the same 
color i is assigned the color i. 

Thus, edges of non-negative color cut through the boundary 
contour coloring in a “transverse" manner. 

So far, we have only considered walks consisting of tri- 
angles. In tlK following, we consider walks of edges. A 
sequence of edges i/», 1 < t < k is called a walk, if every 
two edges following one another in the walk share a vertex 
and no edge appears more than once in the walk. A walk 
(of edges) = (j}i)i<i<k is called a section if it has the 
following properties; 

• All edges in rj have non-negative color, except for those 
corresponding to triangles of (locally) maximal color hav- 
ing three adjacent (over an edge) triangles of lower color. 

• The first and last edges are of color 0. 

• The color of the edges in the walk is strictly increasing 
or decreasing, except for at most two adjacent edges of 
maximal color. 

The first property ensures that sections cut transversally 
through the color layers and allows isolated maxima to be 
bypassed. The second property states that sections are “an- 
chored” to the domain boundary, wliile the last property 
gives the walk tlie shape of an arc (color » height) and ex- 
cludes certain pathological cases. Sections model the be- 
havior of levels in the Cuthill-McKee algorithm. This is ob- 
vious for structured grids. For unstructured grids, sections 
have tlie advantage that, via the coloring, they are aware of 
structural changes in the mesh, and avoid the unpleasant di- 
vergence and separation of the levels. We state this more 
prcci.sely in the next section. 

32. Deformations and Critical Sections 

Let r/n,f/6 be two sections. We call rjh elementary 
deformation ot'ijn (and vice-versa) if the following holds: 

• There exist two triiuigles on the domain boundary such 
tliat the initial and final edges ot both r]„ and i;* are adja- 
cent to them. 

• Two vertices where i/„ and i/*, cut tlirough the siune txnind- 
ary between two color contours are either identical or sep- 
arated by an edge of color - 1 . 



The first requirement ensures that an elementary defor- 
mation of a section is not too far away from the given sec- 
tion. The second requirement controls the “smoothness” 
of the transition. TVvo sections rja and are called defor- 
mations of one another if they can be deformed into each 
other by a sequence of elementary deformations. In other 
words, deformation is an equivalence relation on tie set of 
sections. From an algorithmic point of view, this definition 
appears rather imsadsfactory since it might be hard to deter- 
mine in practice if two sections can be deformed into each 
other. However, proposition 3.1 shows that this issue can 
be resolved for practical purposes. The mathematical the- 
ory was established about 60 years ago, and served as our 
primary motivatioa 

We call a section critical if it has non-trivial deforma- 
tions to one side only. (Tlie meaning of “side” is obvious 
for simply coiuiected domains. We save the reader from 
the rather lengthy discussion for the non-simply connected 
case.) 

3.2.1. An Aside to Morse Theory 

We refer the reader to [6, 8] for an introduction to Morse 
theory. Consider the following real-valued function on the 
Torus T*. Let / : ^ R be the height above the plane V 

(see Fig. 4). A point xo G T* is called a critical point of 


S 



Rgure 4. Critical Points. 

/ if the gradient of / vanishes at xq. J{xo) is then called 
a critical value. Points p, q, r, and s in Fig. 4 are critical. 
One of the central results in Morse theory can be stated as 
follows: 

Theorem 3.1. Let J be a smooth real-valued function on a 
manifold AI. Let a < b and suppose that the set /“ 6], 

consisting of all p € M with a < f{p) <b, is compact and 
contains no critical points off. Then, /~ ‘(o) and f~^(b) 
are isomorphic. □ 

In otlier words, given a Morse function, its critical points 
serve as “sentinels” for stnictural changes. Apart from these 
sentinels, undi.sturhed deformation is possible. 


Returning to our discussion in Sec. 3.2, we would like 
to have a result similar to Theorem 3.1 which would allow 
us to determine if a region bounded by sections is free of 
critical sections that are deformations of one of the bound- 
ing sections. Consider a simply connected region iZ of the 
mesh whose boundary consists of two disconnected compo- 
nents of the boundary and two (disjoint) sections. If there 
is no critical section between the two sections, which is a 
deformation of one of them, they can be deformed into each 
other. We can prove the following sufficient condition for a 
region to have this property. 

Proposition 3.1. Let R be a region as described above. As- 
sume that there are no triangles in a connected contour of 
R of non-maximal color which have three neighbors (adja- 
cent over an edge) of the same color. Furthermore, assume 
that if a triangle t in Ris of (locally) maximal color and 
two neighbors of smaller color are adjacent with t over an 
edge, then they belong to different contours of R. Under 
these assumptions, there are no critical sections in R which 
are deformations of one of the sections on the boundary of 
R. □ 

The assumptions in Proposition 3. 1 ensure that contours 
of nonmaximal color do not have an interior (which they 
might have in the neighborhood of branches or nodes of 
very high degree), and that clusters of maximal color have 
a smooth boundary, rather than be fragmented. Note that 
the assumptions of Proposition 3.1 are sufficient, not nec- 
essary. Thus, there might be regions which do not satisfy 
these assumptions, but the assertion is still tme. These con- 
ditions can be easily verified, which makes them applicable 
for practical purposes. They are satisfied, except for two 
triangles (which can be fixed easily), by the mesh in Fig. 3 
for the relevattt nine regions (see Figure 5). As a conclusion 
of Proposition 3.1 , we find that a region reaches it maximal 
extension if both of the bounding sections turn into a critical 
section. 

Unfortunately, we are not experts in mesh generation. 
However, we strongly believe that there is an intimate con- 
nection between Morse functions and what is considered to 
be an adequate mesh for a given physical domain. 

3 J. The Partitioning Problem 

Based on our previous discussions, a mesh can be de- 
composed into foliated regions, leaving its core and rather 
small critical regions where the foliations undergo structural 
changes. To a large extent, the success of modem graph 
partitioners relies on a multilevel approach, their ability to 
contract or coarsen a given graph into smaller graph(s) and 
propagate panitioning information from coarser levels back 
to the initial problem. With our decomposition approach we 
“virtually” accompli.sh something similar. Figure 5 shows a 




Figure 5. Critical regions of the A mesh. 


schematic representation of the decomposition of the letter 
A mesh, and a problem graph for the partitioning problem. 

The white regions are bounded by critical sections which 
can be freely deformed inside the region. The shaded re- 
gions mark areas where the boundary contour coloring un- 
dergoes essential changes and the structure is not as simple 
as that of the white regions. With each critical region, we 
associate a vertex weighted by the number ot triangles in it. 
This region should be considered to be rather complex and 
stiff, and we want to avoid those regions in the process of 
determining partition boundaries. With each white region 
we associate an edge, weighted in the same manner by the 
number of triangles in it. 

A partitioning problem can now be formulated as fol- 
lows: find n sections, with n depending on the connected- 
ness of the domain (holes?) and the number of partitions 
desired, such that each partition contains about the same 
number of triangles and the total length of the sections is 
minimal. 

The reduced A mesh graph is two-connected. For two 
partitions, we would need two sections in the mesh. Ob- 
viously, the sections would be made in the regions corre- 
sponding to the edges (4,6) and (5,6). For sections, we gen- 
erally have good control over their length. The length of the 
two sections for the A mesh would be 3 or 4 and 9 or 10, 
respectively, with about 640 triangles in each partition. 

The proposed partitioning method can be applied in a re- 
cursive manner. In this process, a critical section usually 
remains critical. On the one hand, this simplifies the task 
of finding critical sections, but on the other hand, imposes 
certain requirements for mesh generation: it the mesh prac- 
tically consists of critical regions only, tliis method is going 
to fail. 

The practical (piirallel) searcli for sections is based on 
the heuristic that .sufficiently deformable sections are likely 
to be found in the neighlxuhood of local maxima or saddle 
points of the boundiiry contour coloring. Notice, that we 
do not have to search for critical sections: we find them 


naturally in the process of determining the “elasticity" of a 
region. 

4. Summary 

In this paper, we proposed a new approach to runtime 
partitioning of adaptive unstmetured grids. Its inherent par- 
allelism stems from a natural decomposition of the under- 
lying mesh. A comprehensive comparison with multilevel 
diffusion techniques needs to be performed in order to bet- 
ter understand the strengths and weaknesses of the method. 
Furthermore, we must achieve a better comprehension of 
the implications for mesh generation. 
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